Concentration of kernel matrices with application to kernel spectral clustering
نویسندگان
چکیده
We study the concentration of random kernel matrices around their mean. derive nonasymptotic exponential inequalities for Lipschitz kernels assuming that data points are independent draws from a class multivariate distributions on $\mathbb{R}^{d}$, including strongly log-concave under affine transformations. A feature our result is need not have identical or zero mean, which key in certain applications such as clustering. Our bound dimension-free and sharp up to constants. For comparison, we also companion Euclidean (inner product) sub-Gaussian distributions. notable difference between two cases that, contrast kernel, case, inequality does depend mean underlying vectors. As an application these inequalities, misclassification rate spectral clustering (KSC) algorithm, perturbed nonparametric mixture model. show example where this establishes high-dimensional consistency (as $d\to \infty $) KSC, when applied with Gaussian noisy model nested nonlinear manifolds.
منابع مشابه
Kernel Cuts: MRF meets Kernel&Spectral Clustering
The log-likelihood energy term in popular model-fitting segmentation methods, e.g. [64, 14, 50, 20], is presented as a generalized “probabilistic” K-means energy [33] for color space clustering. This interpretation reveals some limitations, e.g. over-fitting. We propose an alternative approach to color clustering using kernel K-means energy with well-known properties such as non-linear separati...
متن کاملSpectral Norm of Random Kernel Matrices with Applications to Privacy
Kernel methods are an extremely popular set of techniques used for many important machine learning and data analysis applications. In addition to having good practical performance, these methods are supported by a well-developed theory. Kernel methods use an implicit mapping of the input data into a high dimensional feature space defined by a kernel function, i.e., a function returning the inne...
متن کاملHighly Sparse Reductions to Kernel Spectral Clustering
Kernel spectral clustering is a model-based spectral clustering method formulated in a primal-dual framework. It has a powerful out-of-sample extension property and a model selection procedure based on the balanced line fit criterion. This paper is an improvement of a previous work which sparsified the kernel spectral clustering method using the line structure of the data projections in the eig...
متن کاملSpectral Kernel Methods for Clustering
In this paper we introduce new algorithms for unsupervised learning based on the use of a kernel matrix. All the information required by such algorithms is contained in the eigenvectors of the matrix or of closely related matrices. We use two different but related cost functions, the Alignment and the 'cut cost'. The first one is discussed in a companion paper [3], the second one is based on gr...
متن کاملKernel Spectral Clustering and applications
In this chapter we review the main literature related to kernel spectral clustering (KSC), an approach to clustering cast within a kernel-based optimization setting. KSC represents a least-squares support vector machine based formulation of spectral clustering described by a weighted kernel PCA objective. Just as in the classifier case, the binary clustering model is expressed by a hyperplane i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Annals of Statistics
سال: 2021
ISSN: ['0090-5364', '2168-8966']
DOI: https://doi.org/10.1214/20-aos1967